Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



o 



.CM 



Beschei n i g u ng Certif i cate 



Attestation 



*3 



Die angehefteten Unterla- 
gen stimmen mit der 
ursprunglich eingereichten 
Fassung der auf dem nach- 
sien Blatt bezeichneten 
europalschen Patentanmel- 
dung uberein. 



The attached documents 
are exact copies of the 
European patent application 
described on the following 
page, as originally filed. 



Les documents fixes a 
cette attestation sont 
conformes a la version 
initialement deposee de 
la demande de brevet 
europeen specifiee a la 
page suivante. 



Patentanrneldung Nr. Patent application No. Demande de brevet n° 

01200082.4 



Der President des Europaischen Patentamts; 
Im Auftrag 

For the President of the European Patent Office 

Le President de I'Office europeen des brevets 
p.o. 




I.L.C. HATTEN-HECKMAN 



DEN HAAG,DEN 

THE HAGUE, 05/10/01 

LA HAYE,LE 




Europaisches 
Patentamt 



European 
Patent Office 



Office europeen 
des brevets 



Blatt 2 der Bescheinigung 
Sheet 2 of the certificate 
Page 2 de I attestation 



Anmeldung Nr.: 
Application no.: 
Demande n°: 



01200082.4 




stag: 

filing: 11/01/01 
depot: 



Anmelder 

Applicant(s): 

Demandeur(s): 



KonlnkHjke Philips Electronics N.V. 

5621 BA Eindhoven 

NETHERLANDS 



Bezeichnung der Erfindung: 
Title of the invention: 
Titre de I'invention: 

Recognizing film and video objects occurlng 1n parallel 1n single television signal fields 



In Anspruch genommene Prioriat(en) / Priority(ies) claimed / Priorite(s) revendiquee(s) 

Staat: Tag: Aktenzeichen: 

State: Date: File no. 

Pays: Date: Numero de depot: 



I nternationa le Patent kla ssif i kat ion: 
International Patent classification: 
Classification Internationale des brevets: 



Am Anmeldetag benannte Vertragstaaten: 

Contracting states designated at date of filing: AT/BE/CH/CY/DE/DK/ES/FI/FR/GB/GR/IE/IT/L1/LU/MC/NLj/PT/SE/TR 
Etats contractants designes lors du depot: 

Bemerkungen: 

Remarks: 

Remarques: 



EPA/EPO/OEB Form 1012 -11.00 



/ 



1 10.01.2001 
Recognizing film and video objects occuring in parallel in single television signal fields 
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FIELD OF THE INVENTION 




The present invention relates to the field of detecting motion picture film 
sources in film material. 

PRIOR ART 

In US-A-5,734,735 a method and system is described that analyses a series of 
video images. The types of production media used to produce these video images are 
detected. Each of the series of video images is segmented into a series of cells in order to 
retain spatial information. The spatial information is used to detect the type of production 
media. No technique is disclosed to detect types of production for different scenes within one 
image, coming from different sources and being mixed to form the single image. 

US-A-6,014,1 82 also relates to methods for detecting motion picture film 
sources. Such a detection might be useful in several environments, like, line doublers, 
television standard converters, television slow motion processing and video compression. For 
instance, a 60 Hz NTSC television signal has a 24 frame/second motion picture film as its 
source. In such a scheme, a 3-2 pull-down ratio is used, i.e., three video fields come from one 
film frame whereas the next two video fields come from the next film frame, etc. E.g., calling 
subsequent video fields A, B, C, D, E, a 3-2 pull-down ratio would look like 
AAABBCCCDDEEE. Other sources have a 2-2 pull down ratio or relate to video camera, as 
is known to persons skilled in the art. Thus, comparing successive fields yields information 
about the motion picture source used. 

US-A-5,365,280 proposes to use different motion vectors for different fields 
and to generate a picture signal processing mode control signal that can be used by a 
television receiver as an indication that the fields relate either to movie-film or non-movie- 
film. 

Motion estimation algorithms can be found in M.Tekalp, "Digital Video 
Processing", Prentice Hall, ISBN 0-13-190075-7. An overview of object based motion 
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estimation methods is given by Paolo Vicari, "Representation and regularization of motion 
fields with region-based models", thesis for the Politecnico di Milano, no. 598034. 



SUMMARY OF THE INVENTION 

5 

So far, the prior has concentrated on detecting motion picture sources of either 
films having fields originating from a single motion picture source or films having 
subsequent fields originating from two or more different motion picture sources. However, an 
increasing number of films comprise mixtures of images within fields that originate from 

10 different motion picture sources. None of the prior art methods discussed above, are able to 
detect the picture repetition mode of individual images within fields of a film. For instance, 
in applications in picture rate conversion, however, an indication of the origin of the 
individual images within the fields is to be known. More particularly, it is necessary to know 
whether the video originates from film material to optimally perform de-interlacing and film 

1 5 judder removal. 

Therefore, it is an objective of the present invention to provide an apparatus 
and a method allowing to detect the picture repetition mode of individual objects within 
fields. In this context, an "object" may be a portion of an individual image in a field. An 
"object" is defined as an image portion that can be described with a single motion model. 

20 Such an "object" need not necessarily comprise one "physical" object, like a picture of one 
person. An object may well relate to more than one physical object, e.g., a person sitting on a 
bike where the movement of the person and the bike, essentially, can be described with the 
same motion model. On the other hand, one can safely assume that objects identified in this 
way belong to one single image originating from one single film source. 

25 To obtain the objective of the present invention, it provides a method to detect 

a picture repetition mode of film material comprising a series of consecutive fields, the 
method comprising the following steps: 

> Establishing a motion parameter pattern for the film material; 

> Comparing the pattern with a number of predetermined motion parameter patterns; 
30 > Determining the picture repetition mode using the result of the preceding step; 

characterized in that, the method includes the following steps: 

• Identifying a plurality of different objects within the consecutive fields using a 

segmentation method, an object being defined as an image portion of the consecutive 

fields that can be described with a single motion model; 
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• Carrying out the following steps: 

> Establishing a motion parameter pattern for each one of the objects within the 
consecutive fields; 

> Comparing the motion parameter pattern with a number of predetermined motion 
5 parameter patterns; 

> Determining the picture repetition mode for each one of the objects using the result of 
the preceding step. 

Thus, in accordance with the present invention, prior to detecting a film mode, 
10 the fields of the television signal are separated into different objects by means of a 

segmentation technique. Any known technique to do so might be used for that purpose. Then, 
the film mode of each individual object is detected. Any known film mode detection 
technique might be used for that purpose. 

Preferably, a motion parameter estimation technique is used as well. 
15 So far, as the inventors are aware of, nobody has tried to use the technique of 

motion parameter estimation to identify different image portions (objects) originating from 
different sources because of mixing. 

The invention also relates to an arrangement to detect a picture repetition 
mode of film material comprising a series of consecutive fields, the arrangement comprising 
20 processing means and a memory, the processing means being arranged to carry out the 
following steps: 

> Establishing a motion parameter pattern for the film material; 

> Comparing the pattern with a number of predetermined motion parameter patterns stored 
in the memory; 

25 > Determining the picture repetition mode using the result of the preceding step; 

characterized in that, the processing means are arranged to carry out the following steps: 

• Identifying a plurality of different objects within the consecutive fields using a 
segmentation method, an object being defined as an image portion of the consecutive 
fields that can be described with a single motion model; 

30 • Carrying out the following steps: 

> Establishing a motion parameter pattern for each one of the objects within the 
consecutive fields; 
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> Comparing the motion parameter pattern with a number of predetermined motion 
parameter patterns stored in the memory; 

> Determining the picture repetition mode for each one of the objects using the result of 
the preceding step. 

5 

Such an arrangement may, advantageously, be implemented on a chip. A 
television comprising such a chip, as well as the chip itself, are also claimed in this invention. 

The invention also relates to a computer program product to be loaded by a 
computer arrangement, comprising instructions to detect a picture repetition mode of film 
10 material comprising a series of consecutive fields, the arrangement comprising processing 
means and a memory, the computer program product, after being loaded, providing the 
processing means with the capability to carry out the following steps: 

> Establishing a motion parameter pattern for the film material; 

> Comparing the pattern with a number of predetermined motion parameter patterns stored 
15 in the memory; 

> Determining the picture repetition mode using the result of the preceding step; 
characterized in that, the processing means are arranged to carry out the following steps: 

• Identifying a plurality of different objects within the consecutive fields using a 
segmentation method, an object being defined as an image portion of the consecutive 

20 fields that can be described with a single motion model; 

• Carrying out the following steps: 

> Establishing a motion parameter pattern for each one of the objects within the 
consecutive fields; 

> Comparing the motion parameter pattern with a number of predetermined motion 
25 parameter patterns stored in the memory; 

> Determining the picture repetition mode for each one of the objects using the result of 
the preceding step. 



30 BRIEF DESCRIPTION OF THE DRAWINGS 



The invention will now be explained with reference to some drawings that are 
only intended to illustrate the present invention and not to limit its scope. The scope is only 
limited by the annexed claims. 
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Figure 1 shows a block diagram of a multiple parameter estimator and 
segmentation arrangement. 

Figures 2A, 2B, 2C, 2D show television screen photographs illustrating a 
process of selecting points of interest on which parameter estimators optimise their 
5 parameters. 

Figures 3 A, 3B, 3C, 3D show television screen photographs illustrating a 
process of segmentation. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

10 

Introduction 

Hereinafter, a method to detect a film mode of individual objects in a scene is 
proposed. To that end, first of all, a method is described to identify individual objects in a 

15 scene. Individual objects are identified by motion estimation, i.e., those portions of a scene 
that can be described with a same motion model are identified as belonging to a same object 
in the scene. Motion estimators are known as such from the prior art, e.g., from [1], [3], [4], 
[5], and [6]. Of these references, [1] describes a motion estimator allowing to identify objects 
in a scene without the need to apply an image segmentation. 

20 For the present invention, a motion estimator is preferred that is designed to be 

suitable for picture rate conversion, with a computational complexity suitable for consumer 
electronics application, i.e. comparable to [5, 6]. 

The most striking characteristic of the object motion estimator described 
earlier in [1], is that no effort is put in segmenting the image into objects prior to estimation 

25 of the model parameters, like in other prior art object motion estimators. Basically, a 
relatively small number of interesting image parts is selected, and a number of parallel 
motion model parameter estimators is trying to optimize their parameters on this data set. As 
soon as one of the estimators is more successful than another in a certain number of 
interesting image parts, it is focused on those parts, whereas the remaining estimators focus 

30 on the other parts. In short: individual estimators try to conquer image parts from one 

another, dividing the total image into "objects". This prior art object motion estimator allows 
a real-time object-based motion estimation and can advantageously be used in the film 
detection technique of the present invention. 
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Fundamentally, such an object-based motion estimator that wastes no effort in 
expensive segmentation of the image should be able to compete in operations count with a 
block based motion estimator, as one should expect less objects than blocks in realistic 
images. It is only in the assignment of image parts to objects that an effort is required 
5 comparable to the evaluation of candidate vectors on block basis. If the number of objects 
does not exceed the number of candidate vectors too much, the overhead of an object based 
motion estimator should be negligible. It is assumed here that the motion per object can be 
described with fairly simple parametric models. 

In the following subsections, we shall describe a preferred motion model used, 
10 an estimation of motion model parameters, a preferred cost function used, a segmentation 
process and a film mode detection for individual objects within a scene. 

Motion model 

15 To keep complexity low, the motion of each object o is described by a simple 

first order linear model that can only describe translation and scaling. More complex 
parametric motion models are known to persons skilled in the art, e.g., models including 
rotation, and can indeed be applied in combination with the proposed algorithm, but will be 
disregarded here, as we shall introduce a refinement that makes such complex models 

20 obsolete. 

The model used is: 



a N f s x {o 9 n) + xd x ip 9 n) y 
{s y (o 9 n) + yd y (o,n)) 



(1) 



25 using D 0 (3c, n) for the displacement vector of object o at location x = in 



the image with index n. It is observed that x is associated with pixel locations. 




Parameter estimation 
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Given a motion model, next its parameters need to be optimized for a given 
object in the image. As stationary image parts occur in almost every sequence, we assume the 
5 presence of an 'object o, o > 0', for which motion is described by 0 , the zero vector. Clearly 
no estimation effort is required to make this available. The parameter vectors of additional 
objects o, o > 0, are estimated separately, in parallel, by their respective parameter estimators 
(PE m> m = 1,2,..., M), as shown in Figure 1 . 

Figure 1 shows a block diagram of an arrangement with a plurality of 
10 parameter estimators PE m (n) connected in parallel to the output of a data reduction unit DRU 
The data reduction unit DRU is arranged to select a set of interesting image pixels that are to 
be used in the calculations made. Inputs to the data reduction unit DRU are the image at time 
n and said image at time Each of the outputs of the PE m (n) is connected to a 
segmentation unit SU. 

1 5 The output of the segmentation unit SU is fed back to the parameter estimators 

PE m (n) since, preferably, they together perform a recursive operation as will be explained 
below. The end result of the segmentation process is formed by groups of pixels of a scene, 
each group of pixels belonging to a different object and having assigned to it a different 
motion vector. These output data are supplied to a processing unit PU that is arranged to 

20 detect the type of film source per object and to perform predetermined tasks on the different 
objects such as picture rate conversion. The processing unit PU is connected to memory M 
storing predetermined motion parameter patterns used to detect the type of film source as will 
be explained below. The memory Mmay be of any known type, i.e., RAM, ROM, EEPROM, 
hard disc, etc. The output of the processing unit PU, for instance, controls a television screen. 

25 It is observed that the data reduction unit DRU, the parameter estimators 

PE m (n), the segmentation unit St/and the processing unit PC/ are shown as separate blocks. 
These blocks may be implemented as separate intelligent units having distinct processors and. 
memories. However, as is evident to persons skilled in the art, these units may be integrated 
into a single unit such as a general purpose microprocessor comprising a processor and 

30 suitable memory loaded with suitable software. Such a microprocessor is not shown but 

known from any computer handbook. Alternatively, the arrangement shown in figure 1 may 
be implemented as a hard wired logic unit, as known to persons skilled in the art. Preferably, 
the entire arrangement shown in figure 1 is encapsulated as a single chip in a single package. 
Such a single chip package can be easily included in a television apparatus. 
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Each PE m (n) updates a previously estimated parameter vector, after which the 

best parameter candidate vector, according to a cost function, is selected as the result 

parameter vector for that object. 

Considering the four parameter model of equation (1), the parameters of object 

o, o > 0, are regarded as a parameter vector P Q (ri) : 



s y (o,ri) 
d x (o,ri) 
{d y (o,ri)j 



(2) 



and we define our task as to select P Q (ri) from a number of candidate 
parameter vectors C Q (ri) as the one that has the minimal value of a cost function, to which 

we shall return later on. 

Preferably, the candidates are generated much similar to the strategy exploited 
in [5, 6], i.e. take a prediction vector, add at least one update vector, and select the best 
candidate parameter vector according to an error criterion. Candidate parameter set CS 0 (n) 

contains three candidates C 0 (ri) according to: 



CS Q (ri) = {c o (ri)\C Q (ri) = P 0 (n - 1) + m0 o (ri), U Q (ri) g US 0 (ri) 9 m = -l,0,l} 



(3) 



with update parameter U Q (ri) selected from update parameter set US Q (n): 



US 0 (n) = { 



0 
0 



i 
0 
\0j 



(0^ 
0 



o 

0 



(4) 



(i=l,2,4,8,16) 
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The cost function 

Given the motion model and some candidate parameter sets, we need to select 
the best candidate, according to a cost function, as the result for a given object. The cost 
5 function can be a sum of absolute differences between motion compensated pixels from 

neighboring images, with vectors generated with the (candidate) motion model. However, we 
need to know the area to which the motion model is to be assigned. The two issues, 
segmentation and motion estimation, are inter-dependent. In order to correctly estimate the 
motion in one object, the object should be known and vice versa. 
10 As a first step in the motion estimation process, we define a set with pixel 

blocks of interest. These form the set SI(n) of "interesting" image parts that will be used as a 
basis for optimization of all parametric models. 

Now, the focus of the individual parameter estimators has to be on different 
objects. To this end, each parameter estimator PE m (n) will calculate its cost function on the 
1 5 same set of interesting locations defined in set SI 9 giving different locations a different weight 
factor, W 0 (X) . Here, X is associated with a position of a block of pixels. The proposed 

algorithm is straightforward: 

♦ The pixel values are multiplied with a first weight factor larger than 1, e.g. 8, in 
case the pixel in SI(n) belonged to the same object, i.e. the same parameter 

20 estimator, according to the previous image segmentation step. 

♦ The pixel values are multiplied with a second weight factor smaller than 1, e.g. 
0.1 , in case the segmentation assigned the position to another parameter estimator 
and this estimator achieved low match errors. 



25 Figure 2 gives an example of a selection of pixel blocks of interest in an image 

with a single moving object, i.e., a bicyclist, and a moving background. This selection is 
carried out by the Data Reduction Unit DRU. Thus, the Data Reduction Unit renders a set of 
most interesting pixel elements (ST), resulting in a rather cheap (few calculations) and an 
effective parameter estimation. Figure 2 shows screen photographs illustrating a process of 

30 selecting points of interest on which the parameter estimators optimize their parameters. The 
temporal difference image, between two successive pictures, is not actually calculated, but it 

serves to understand why the high match errors of the vector 0 , i.e. the total set with points 
of interest, are at the positions shown in figure 3C. In figure 3D it is shown how, in this 
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example, the focus of two parameter estimators is divided over the points of interest. I.e., 
figure 3D shows that there are two different motion models detected. The two sub-sets are 
shown in a different brightness, i.e., one in black and the other one in grey. 

The moving background of the image is object o = 1, and the bicyclist is 
object o = 2. There are two parameter estimators that are both optimized on the same set 
containing the blocks of interest, but as soon as one estimator is selected in the segmentation 
to be best in an area, the pixel block of interest in that area is emphasized in the cost function. 
After a while, this converges to the situation illustrated, where one estimator focuses on the 
grey blocks and the other on the white pixel blocks in SI(n). 

More formally, the cost function is calculated according to: 

s(C Q ,n)=Y, W <> &)\ F s «) Co (*■ *)> n - 1)| (5) 

xeSI 

where F s (x, n) is the luminance value of a pixel at position x in a sub- 
sampled image with index n 9 and C Q (x, n) is the vector resulting from candidate model 

C 0 (n) at position 3c . 

The sub-sampling effectively reduces the required memory bandwidth. Images 
are sub-sampled with a factor of four horizontally and a factor of two vertically on a field 
base, generating a sub-sampled image F s (n) from each original field F(n). In order to achieve 
pixel accuracy on the original pixel grid of F, interpolation is required on the sub-sampling 
grid. 

Recursive segmentation 

The segmentation is the most critical step in the algorithm. Its task is to assign 
one motion model to each group of pixels. For each block, a block match error, s Q (X, n) 
corresponding to each of the estimated parameter vectors, P 0 , can be calculated according to: 

xeB(X) 



The temporal instance where this segmentation is valid is defined by a. 
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We adopted a recursive segmentation method that closely resembles the 
strategy of a 3-D RS block matcher, e.g. as disclosed in [5], i.e. use spatial and temporal 
predictions of the best PE m (n) and penalize choosing a PE m (n) that does not occur in the 
spatio-temporal neighborhood. Formally, the segmentation mask M(X,n) assigns the object 

o with the lowest local modified cost function e Q (X 9 n) to the block B(X) , where 



10 



while P(X, n) is a penalty chosen according to the following rule: 



P s9 (M(X + 5,n) = o) 
P ( ,(M{X-S 9 n-l) = o) 
P u , (otherwise) 



(8) 



and 



15 



8 = 



i,J = 0 9 ±\ 



(9) 



Similar to what has been suggested for the 3-D RS block matcher [5], P u is the 
largest penalty, P t just a small one, while there is no reason why P s could not just be zero. A 
fairly obvious simplification is to fix 8 to the direction opposite to the scanning direction, 

20 and to alternate the scanning from field to field. Figure 3 A-3D give an example of a 

segmentation according to the object-based motion estimation method, with the original 
luminance image. Figures 3 A-3D show photographs taken from a television screen and 
illustrating the process of segmentation. Figure 3A shows the original image whereas figures 
3B-3D show consecutive segmentation results. Clearly, the first image in figure 3 A has a 

25 poor, almost random, segmentation. However, the focussing of the individual estimators to 
their area in the segmentation rapidly converges to a useful segmentation: figure 3D shows 
that two different objects can be distinguished, one relating to the bicyclist and one relating to 
the back ground. 



DD 



DU=<g)D=»D 




PHNL010005EPP 





12 



10.01.2001 



Prior art film-mode recognition 

Apart from the calculation of motion vectors for every object in the picture, 
applications in picture rate conversion require an indication of the origin of the picture 
5 sequence. More particularly, it is necessary to know whether the video originates from film 
material to optimally perform de-interlacing and film judder removal. Moreover, it is 
necessary to distinguish between 2-2 pull down image material, 2-3 pull down material, and 
video from a video camera. 

As discussed earlier here, in prior art methods, this detection concerns a global 
10 decision, i.e. discrimination between video camera and the various film formats is done only 
for entire images. 

As an adaptation of [8], for the object based motion estimator, a reliable movie 
detector can be realized analyzing the motion described by the parameter estimator only that 
covers the largest area of the image, obviously disregarding the zero-vector 'estimator'. 
1 5 Let us define max(n) as the largest component of parameter vector P 0 (n) 

(rather than taking the largest component of the parameter vector, it is equally well possible 
to use the average, absolute, or the summed absolute value of either or both of the parameter 
components), i.e. 

20 max(n) = max{s x (o f n) ) s y (o,n), d x (o,n), d y (o s n)} (10) 



which with adaptive thresholding is converted into a binary movie detection 
set MD(n) y that for 2-2 pull-down will gives something like: 



We now assemble the recent history set RH(ri) as: 



RH(n) = (max(n) y max(n-l), max(n-2), max(n-3), max(n-4), max(n-5), max(n-6)} 



25 



(11) 



30 



MD(n) = {0,1,0,1,0,1,0}, 



(12) 



for 2-3 pull— down something like: 



mzy«; = {0,1,0,0,1,0,1}, 



(13) 



5 



10 



25 



30 
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and for video something like: 

MD^ = {U,1,UU}. (14) 

Comparing the actual set with a limited number of known patterns stored in 
memory M> yields information on movie type and phase. In case of scene cuts, the detector 
yields the output unreliable, which indicates that motion compensation can better be switched 
off. 

Film-mode recognition according to the invention 



The invention concerns a method to detect the film mode of individual objects 
in a scene. More and more, images from different sources are mixed during production. We, 
1 5 therefore, propose to adapt the object based motion estimator such that it, along with the 
motion parameter estimation of the objects in the scene, decides upon their origin. 

To this end, we analyze the motion described by all individual parameter 

estimators. 

Let us define max 0 (n) as the largest component of parameter vector P 0 (n) 
20 (rather than taking the largest component of the parameter vector, it is equally well possible 
to use the average, absolute, or the summed absolute value of either or both of the parameter 
components), i.e. 



max 0 (n) = max{s x (o,n), s y (o t n) t d x (o,n), d y (o,n)}. (15) 
We now assemble the recent history sets RH Q (n) as: 

RH 0 (n) = {max 0 (n), max 0 (n-l), max 0 (n-2), max 0 (n-3), max 0 (n-4), max 0 (n-5), 
max 0 (n-6) (16) 

which with adaptive thresholding are converted into binary movie detection 
sets MD 0 (n) y that for a 2-2 pull-down object will give something like: 



MD 0 (n) = {0,1,0,1,0,1,0}, 



(17) 
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for 2-3 pull-down something like: 



MD 0 (n) = {0,1,0,0,1,0,1}, 



(18) 



and for video something like: 



MD 9 (n)= {1,1,1,1,1,1.1}. 



(19) 



10 Comparing the actual set with a limited number of known patterns stored in 

memory M, yields information on movie type and phase for every individual object. In case 
of scene cuts, the detector yields the output unreliable, which indicates that motion 
compensation can better be switched off for all objects. 
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1 . A method to detect a picture repetition mode of film material comprising a 
series of consecutive fields, the method comprising the following steps: 

> Establishing a motion parameter pattern for said film material; 

> Comparing said pattern with a number of predetermined motion parameter patterns; 
5 > Determining said picture repetition mode using the result of the preceding step; 

characterized in that, said method includes the following steps: 

• Identifying a plurality of different objects within said consecutive fields using a 

segmentation method, an object being defined as an image portion of said consecutive 

fields that can be described with a single motion model; 

10 • Carrying out the following steps: 

> Establishing a motion parameter pattern for each one of said objects within said 
consecutive fields; 

> Comparing said motion parameter pattern with a number of predetermined motion 
parameter patterns; 

15 > Determining said picture repetition mode for each one of said objects using the result 

of the preceding step. 

2. Method according to claim 1, wherein said plurality of different objects are 
also identified using a motion estimation technique. 

20 

3. Method according to claim 2, wherein a plurality of motion model parameter 
estimators (PE m (n)) operating in parallel is used to carry out said motion estimation 
technique. 

25 4. Method according claim 1 5 wherein a recursive segmentation method is used 

to identify said plurality of objects. 

5. Method according to claim 1, wherein a data reduction method is used. 
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6. Method according to claim 1 , wherein said predetermined motion parameter 

patterns relate to one of the following set of film modes: a 2-2 pull-down mode, a 3-2 pull- 
down mode, and video mode. 



5 7. Method according to claim 1 , comprising the further step of carrying out a 

film material processing step. 

8. Method according to claim 7, wherein said film material processing step 

comprises at least one of the following steps: picture rate conversion, de-interlacing, and film 
1 0 judder removal. 



9. Arrangement to detect a picture repetition mode of film material comprising a 
series of consecutive fields, the arrangement comprising processing means and a memory 
(M), the processing means being arranged to carry out the following steps: 

15 > Establishing a motion parameter pattern for said film material; 

> Comparing said pattern with a number of predetermined motion parameter patterns stored 
in said memory (M); 

> Determining said picture repetition mode using the result of the preceding step; 
characterized in that, said processing means are arranged to carry out the following steps: 

20 • Identifying a plurality of different objects within said consecutive fields using a 

segmentation method, an object being defined as an image portion of said consecutive 
fields that can be described with a single motion model; 

• Carrying out the following steps: 

> Establishing a motion parameter pattern for each one of said objects within said 
25 consecutive fields; 

> Comparing said motion parameter pattern with a number of predetermined motion 
parameter patterns stored in said memory; 

> Determining said picture repetition mode for each one of said objects using the result 
of the preceding step. 

30 

10. Arrangement according to claim 9, wherein said processing means are 
arranged to identify said plurality of different objects by also using a motion estimation 
technique. 
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1 1 . Arrangement according to claim 10, comprising a plurality of motion model 

parameter estimators (PEm(n)) operating in parallel to carry out said motion estimation 
technique. 

5 12. Arrangement according to claim 9, comprising a segmentation unit (SU) for 

performing a recursive segmentation method to identify said plurality of objects. 

13. Arrangement according to claim 9, comprising a data reduction unit (DRU). 

10 14. Arrangement according to claim 9, wherein said predetermined motion 

parameter patterns relate to at least one of the following set of film modes: a 2-2 pull-down 
mode, a 3-2 pull-down mode, and video mode. 

15. Arrangement according to claim 9, comprising a film processing unit carrying 
1 5 out a film material processing step. 

16. Arrangement according to claim 15 wherein said film processing unit is 
arranged to carry out at least one of the following steps: picture rate conversion, de- 
interlacing, and film judder removal. 

20 

17. Chip provided with an arrangement according to any of the claims 9 through 
16. 

1 8. Television apparatus provided with a chip according to claim 17. 

25 

1 9. Computer program product to be loaded by a computer arrangement, 
comprising instructions to detect a picture repetition mode of film material comprising a 
series of consecutive fields, the arrangement comprising processing means and a memory 
(M), the computer program product, after being loaded, providing said processing means 

30 with the capability to carry out the following steps: 

> Establishing a motion parameter pattern for said film material; 

> Comparing said pattern with a number of predetermined motion parameter patterns stored 
in said memory (M); 

> Determining said picture repetition mode using the result of the preceding step; 
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characterized in that, said processing means are arranged to carry out the following steps: 

• Identifying a plurality of different objects within said consecutive fields using a motion 
estimation and segmentation method, an object being defined as an image portion of said 
consecutive fields that can be described with a single motion model; 

5 • Carrying out the following steps: 

> Establishing a motion parameter pattern for each one of said objects within said 
consecutive fields; 

> Comparing said motion parameter pattern with a number of predetermined motion 
parameter patterns stored in said memory (M); 

10 > Determining said picture repetition mode for each one of said objects using the result 

of the preceding step. 

20. A data carrier provided with a computer program product according to claim 

19. 
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Method and arrangement to detect a picture repetition mode of film material 
with a series of consecutive fields, the arrangement having processing means and a memory 
(M), the processing means being arranged to carry out the following steps: 

• Identifying a plurality of different objects within the consecutive fields using a 
segmentation method, an object being defined as an image portion of the consecutive 
fields that can be described with a single motion model; 

• Carrying out the following steps for each one of the plurality of objects, i.e.: 

> Establishing a motion parameter pattern for each one of the objects within the 
consecutive fields; 

> Comparing the motion parameter pattern with a number of predetermined motion 
parameter patterns; 

> Determining the picture repetition mode for each one of the objects using the result of 
the preceding step. 



[Fig. 1] 
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